Timestamp for saved files: 2020-12-05_10-13-47
Training parameters
Number of epochs: 200
Step size maximum: 0.02
Step size decay: 9.9995e-05
Batch size: 64
Regularization rate: 0.0001
Saving validation predictions in: /Usersß/Josh Ehrlich/Courses/CISC881/Project/data\PredictionsValidation
Saving models in: /Usersß/Josh Ehrlich/Courses/CISC881/Project/data\SavedModels
*** Leave-one-out round # 0
Training on 5803 images, validating on 1515 images...
Model: "functional_11"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_6 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_70 (Conv2D) (None, 64, 64, 8) 80 input_6[0][0]
__________________________________________________________________________________________________
max_pooling2d_35 (MaxPooling2D) (None, 64, 64, 8) 0 conv2d_70[0][0]
__________________________________________________________________________________________________
conv2d_71 (Conv2D) (None, 32, 32, 16) 1168 max_pooling2d_35[0][0]
__________________________________________________________________________________________________
max_pooling2d_36 (MaxPooling2D) (None, 32, 32, 16) 0 conv2d_71[0][0]
__________________________________________________________________________________________________
conv2d_72 (Conv2D) (None, 16, 16, 32) 4640 max_pooling2d_36[0][0]
__________________________________________________________________________________________________
max_pooling2d_37 (MaxPooling2D) (None, 16, 16, 32) 0 conv2d_72[0][0]
__________________________________________________________________________________________________
conv2d_73 (Conv2D) (None, 8, 8, 64) 18496 max_pooling2d_37[0][0]
__________________________________________________________________________________________________
max_pooling2d_38 (MaxPooling2D) (None, 8, 8, 64) 0 conv2d_73[0][0]
__________________________________________________________________________________________________
conv2d_74 (Conv2D) (None, 4, 4, 128) 73856 max_pooling2d_38[0][0]
__________________________________________________________________________________________________
max_pooling2d_39 (MaxPooling2D) (None, 4, 4, 128) 0 conv2d_74[0][0]
__________________________________________________________________________________________________
conv2d_75 (Conv2D) (None, 2, 2, 256) 295168 max_pooling2d_39[0][0]
__________________________________________________________________________________________________
max_pooling2d_40 (MaxPooling2D) (None, 2, 2, 256) 0 conv2d_75[0][0]
__________________________________________________________________________________________________
conv2d_76 (Conv2D) (None, 1, 1, 512) 1180160 max_pooling2d_40[0][0]
__________________________________________________________________________________________________
max_pooling2d_41 (MaxPooling2D) (None, 1, 1, 512) 0 conv2d_76[0][0]
__________________________________________________________________________________________________
up_sampling2d_35 (UpSampling2D) (None, 2, 2, 512) 0 max_pooling2d_41[0][0]
__________________________________________________________________________________________________
concatenate_35 (Concatenate) (None, 2, 2, 768) 0 up_sampling2d_35[0][0]
max_pooling2d_40[0][0]
__________________________________________________________________________________________________
conv2d_77 (Conv2D) (None, 2, 2, 506) 6218234 concatenate_35[0][0]
__________________________________________________________________________________________________
batch_normalization_30 (BatchNo (None, 2, 2, 506) 2024 conv2d_77[0][0]
__________________________________________________________________________________________________
up_sampling2d_36 (UpSampling2D) (None, 4, 4, 506) 0 batch_normalization_30[0][0]
__________________________________________________________________________________________________
concatenate_36 (Concatenate) (None, 4, 4, 634) 0 up_sampling2d_36[0][0]
max_pooling2d_39[0][0]
__________________________________________________________________________________________________
conv2d_78 (Conv2D) (None, 4, 4, 250) 2536250 concatenate_36[0][0]
__________________________________________________________________________________________________
batch_normalization_31 (BatchNo (None, 4, 4, 250) 1000 conv2d_78[0][0]
__________________________________________________________________________________________________
up_sampling2d_37 (UpSampling2D) (None, 8, 8, 250) 0 batch_normalization_31[0][0]
__________________________________________________________________________________________________
concatenate_37 (Concatenate) (None, 8, 8, 314) 0 up_sampling2d_37[0][0]
max_pooling2d_38[0][0]
__________________________________________________________________________________________________
conv2d_79 (Conv2D) (None, 8, 8, 122) 613050 concatenate_37[0][0]
__________________________________________________________________________________________________
batch_normalization_32 (BatchNo (None, 8, 8, 122) 488 conv2d_79[0][0]
__________________________________________________________________________________________________
up_sampling2d_38 (UpSampling2D) (None, 16, 16, 122) 0 batch_normalization_32[0][0]
__________________________________________________________________________________________________
concatenate_38 (Concatenate) (None, 16, 16, 154) 0 up_sampling2d_38[0][0]
max_pooling2d_37[0][0]
__________________________________________________________________________________________________
conv2d_80 (Conv2D) (None, 16, 16, 58) 142970 concatenate_38[0][0]
__________________________________________________________________________________________________
batch_normalization_33 (BatchNo (None, 16, 16, 58) 232 conv2d_80[0][0]
__________________________________________________________________________________________________
up_sampling2d_39 (UpSampling2D) (None, 32, 32, 58) 0 batch_normalization_33[0][0]
__________________________________________________________________________________________________
concatenate_39 (Concatenate) (None, 32, 32, 74) 0 up_sampling2d_39[0][0]
max_pooling2d_36[0][0]
__________________________________________________________________________________________________
conv2d_81 (Conv2D) (None, 32, 32, 26) 30810 concatenate_39[0][0]
__________________________________________________________________________________________________
batch_normalization_34 (BatchNo (None, 32, 32, 26) 104 conv2d_81[0][0]
__________________________________________________________________________________________________
up_sampling2d_40 (UpSampling2D) (None, 64, 64, 26) 0 batch_normalization_34[0][0]
__________________________________________________________________________________________________
concatenate_40 (Concatenate) (None, 64, 64, 34) 0 up_sampling2d_40[0][0]
max_pooling2d_35[0][0]
__________________________________________________________________________________________________
conv2d_82 (Conv2D) (None, 64, 64, 10) 5450 concatenate_40[0][0]
__________________________________________________________________________________________________
batch_normalization_35 (BatchNo (None, 64, 64, 10) 40 conv2d_82[0][0]
__________________________________________________________________________________________________
up_sampling2d_41 (UpSampling2D) (None, 128, 128, 10) 0 batch_normalization_35[0][0]
__________________________________________________________________________________________________
concatenate_41 (Concatenate) (None, 128, 128, 11) 0 up_sampling2d_41[0][0]
input_6[0][0]
__________________________________________________________________________________________________
conv2d_83 (Conv2D) (None, 128, 128, 2) 354 concatenate_41[0][0]
==================================================================================================
Total params: 11,124,574
Trainable params: 11,122,630
Non-trainable params: 1,944
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x000001CF972BE2B0>
Training time: 9:52:42.490424
(1515, 128, 128, 1)
Total round time: 9:52:55.982571
*** Leave-one-out round # 1
Training on 6290 images, validating on 1028 images...
Model: "functional_13"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_7 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_84 (Conv2D) (None, 64, 64, 8) 80 input_7[0][0]
__________________________________________________________________________________________________
max_pooling2d_42 (MaxPooling2D) (None, 64, 64, 8) 0 conv2d_84[0][0]
__________________________________________________________________________________________________
conv2d_85 (Conv2D) (None, 32, 32, 16) 1168 max_pooling2d_42[0][0]
__________________________________________________________________________________________________
max_pooling2d_43 (MaxPooling2D) (None, 32, 32, 16) 0 conv2d_85[0][0]
__________________________________________________________________________________________________
conv2d_86 (Conv2D) (None, 16, 16, 32) 4640 max_pooling2d_43[0][0]
__________________________________________________________________________________________________
max_pooling2d_44 (MaxPooling2D) (None, 16, 16, 32) 0 conv2d_86[0][0]
__________________________________________________________________________________________________
conv2d_87 (Conv2D) (None, 8, 8, 64) 18496 max_pooling2d_44[0][0]
__________________________________________________________________________________________________
max_pooling2d_45 (MaxPooling2D) (None, 8, 8, 64) 0 conv2d_87[0][0]
__________________________________________________________________________________________________
conv2d_88 (Conv2D) (None, 4, 4, 128) 73856 max_pooling2d_45[0][0]
__________________________________________________________________________________________________
max_pooling2d_46 (MaxPooling2D) (None, 4, 4, 128) 0 conv2d_88[0][0]
__________________________________________________________________________________________________
conv2d_89 (Conv2D) (None, 2, 2, 256) 295168 max_pooling2d_46[0][0]
__________________________________________________________________________________________________
max_pooling2d_47 (MaxPooling2D) (None, 2, 2, 256) 0 conv2d_89[0][0]
__________________________________________________________________________________________________
conv2d_90 (Conv2D) (None, 1, 1, 512) 1180160 max_pooling2d_47[0][0]
__________________________________________________________________________________________________
max_pooling2d_48 (MaxPooling2D) (None, 1, 1, 512) 0 conv2d_90[0][0]
__________________________________________________________________________________________________
up_sampling2d_42 (UpSampling2D) (None, 2, 2, 512) 0 max_pooling2d_48[0][0]
__________________________________________________________________________________________________
concatenate_42 (Concatenate) (None, 2, 2, 768) 0 up_sampling2d_42[0][0]
max_pooling2d_47[0][0]
__________________________________________________________________________________________________
conv2d_91 (Conv2D) (None, 2, 2, 506) 6218234 concatenate_42[0][0]
__________________________________________________________________________________________________
batch_normalization_36 (BatchNo (None, 2, 2, 506) 2024 conv2d_91[0][0]
__________________________________________________________________________________________________
up_sampling2d_43 (UpSampling2D) (None, 4, 4, 506) 0 batch_normalization_36[0][0]
__________________________________________________________________________________________________
concatenate_43 (Concatenate) (None, 4, 4, 634) 0 up_sampling2d_43[0][0]
max_pooling2d_46[0][0]
__________________________________________________________________________________________________
conv2d_92 (Conv2D) (None, 4, 4, 250) 2536250 concatenate_43[0][0]
__________________________________________________________________________________________________
batch_normalization_37 (BatchNo (None, 4, 4, 250) 1000 conv2d_92[0][0]
__________________________________________________________________________________________________
up_sampling2d_44 (UpSampling2D) (None, 8, 8, 250) 0 batch_normalization_37[0][0]
__________________________________________________________________________________________________
concatenate_44 (Concatenate) (None, 8, 8, 314) 0 up_sampling2d_44[0][0]
max_pooling2d_45[0][0]
__________________________________________________________________________________________________
conv2d_93 (Conv2D) (None, 8, 8, 122) 613050 concatenate_44[0][0]
__________________________________________________________________________________________________
batch_normalization_38 (BatchNo (None, 8, 8, 122) 488 conv2d_93[0][0]
__________________________________________________________________________________________________
up_sampling2d_45 (UpSampling2D) (None, 16, 16, 122) 0 batch_normalization_38[0][0]
__________________________________________________________________________________________________
concatenate_45 (Concatenate) (None, 16, 16, 154) 0 up_sampling2d_45[0][0]
max_pooling2d_44[0][0]
__________________________________________________________________________________________________
conv2d_94 (Conv2D) (None, 16, 16, 58) 142970 concatenate_45[0][0]
__________________________________________________________________________________________________
batch_normalization_39 (BatchNo (None, 16, 16, 58) 232 conv2d_94[0][0]
__________________________________________________________________________________________________
up_sampling2d_46 (UpSampling2D) (None, 32, 32, 58) 0 batch_normalization_39[0][0]
__________________________________________________________________________________________________
concatenate_46 (Concatenate) (None, 32, 32, 74) 0 up_sampling2d_46[0][0]
max_pooling2d_43[0][0]
__________________________________________________________________________________________________
conv2d_95 (Conv2D) (None, 32, 32, 26) 30810 concatenate_46[0][0]
__________________________________________________________________________________________________
batch_normalization_40 (BatchNo (None, 32, 32, 26) 104 conv2d_95[0][0]
__________________________________________________________________________________________________
up_sampling2d_47 (UpSampling2D) (None, 64, 64, 26) 0 batch_normalization_40[0][0]
__________________________________________________________________________________________________
concatenate_47 (Concatenate) (None, 64, 64, 34) 0 up_sampling2d_47[0][0]
max_pooling2d_42[0][0]
__________________________________________________________________________________________________
conv2d_96 (Conv2D) (None, 64, 64, 10) 5450 concatenate_47[0][0]
__________________________________________________________________________________________________
batch_normalization_41 (BatchNo (None, 64, 64, 10) 40 conv2d_96[0][0]
__________________________________________________________________________________________________
up_sampling2d_48 (UpSampling2D) (None, 128, 128, 10) 0 batch_normalization_41[0][0]
__________________________________________________________________________________________________
concatenate_48 (Concatenate) (None, 128, 128, 11) 0 up_sampling2d_48[0][0]
input_7[0][0]
__________________________________________________________________________________________________
conv2d_97 (Conv2D) (None, 128, 128, 2) 354 concatenate_48[0][0]
==================================================================================================
Total params: 11,124,574
Trainable params: 11,122,630
Non-trainable params: 1,944
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x000001CF95DC51C0>
Training time: 10:35:55.774253
(1028, 128, 128, 1)
Total round time: 10:36:05.406348
*** Leave-one-out round # 2
Training on 6670 images, validating on 648 images...
Model: "functional_15"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_8 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_98 (Conv2D) (None, 64, 64, 8) 80 input_8[0][0]
__________________________________________________________________________________________________
max_pooling2d_49 (MaxPooling2D) (None, 64, 64, 8) 0 conv2d_98[0][0]
__________________________________________________________________________________________________
conv2d_99 (Conv2D) (None, 32, 32, 16) 1168 max_pooling2d_49[0][0]
__________________________________________________________________________________________________
max_pooling2d_50 (MaxPooling2D) (None, 32, 32, 16) 0 conv2d_99[0][0]
__________________________________________________________________________________________________
conv2d_100 (Conv2D) (None, 16, 16, 32) 4640 max_pooling2d_50[0][0]
__________________________________________________________________________________________________
max_pooling2d_51 (MaxPooling2D) (None, 16, 16, 32) 0 conv2d_100[0][0]
__________________________________________________________________________________________________
conv2d_101 (Conv2D) (None, 8, 8, 64) 18496 max_pooling2d_51[0][0]
__________________________________________________________________________________________________
max_pooling2d_52 (MaxPooling2D) (None, 8, 8, 64) 0 conv2d_101[0][0]
__________________________________________________________________________________________________
conv2d_102 (Conv2D) (None, 4, 4, 128) 73856 max_pooling2d_52[0][0]
__________________________________________________________________________________________________
max_pooling2d_53 (MaxPooling2D) (None, 4, 4, 128) 0 conv2d_102[0][0]
__________________________________________________________________________________________________
conv2d_103 (Conv2D) (None, 2, 2, 256) 295168 max_pooling2d_53[0][0]
__________________________________________________________________________________________________
max_pooling2d_54 (MaxPooling2D) (None, 2, 2, 256) 0 conv2d_103[0][0]
__________________________________________________________________________________________________
conv2d_104 (Conv2D) (None, 1, 1, 512) 1180160 max_pooling2d_54[0][0]
__________________________________________________________________________________________________
max_pooling2d_55 (MaxPooling2D) (None, 1, 1, 512) 0 conv2d_104[0][0]
__________________________________________________________________________________________________
up_sampling2d_49 (UpSampling2D) (None, 2, 2, 512) 0 max_pooling2d_55[0][0]
__________________________________________________________________________________________________
concatenate_49 (Concatenate) (None, 2, 2, 768) 0 up_sampling2d_49[0][0]
max_pooling2d_54[0][0]
__________________________________________________________________________________________________
conv2d_105 (Conv2D) (None, 2, 2, 506) 6218234 concatenate_49[0][0]
__________________________________________________________________________________________________
batch_normalization_42 (BatchNo (None, 2, 2, 506) 2024 conv2d_105[0][0]
__________________________________________________________________________________________________
up_sampling2d_50 (UpSampling2D) (None, 4, 4, 506) 0 batch_normalization_42[0][0]
__________________________________________________________________________________________________
concatenate_50 (Concatenate) (None, 4, 4, 634) 0 up_sampling2d_50[0][0]
max_pooling2d_53[0][0]
__________________________________________________________________________________________________
conv2d_106 (Conv2D) (None, 4, 4, 250) 2536250 concatenate_50[0][0]
__________________________________________________________________________________________________
batch_normalization_43 (BatchNo (None, 4, 4, 250) 1000 conv2d_106[0][0]
__________________________________________________________________________________________________
up_sampling2d_51 (UpSampling2D) (None, 8, 8, 250) 0 batch_normalization_43[0][0]
__________________________________________________________________________________________________
concatenate_51 (Concatenate) (None, 8, 8, 314) 0 up_sampling2d_51[0][0]
max_pooling2d_52[0][0]
__________________________________________________________________________________________________
conv2d_107 (Conv2D) (None, 8, 8, 122) 613050 concatenate_51[0][0]
__________________________________________________________________________________________________
batch_normalization_44 (BatchNo (None, 8, 8, 122) 488 conv2d_107[0][0]
__________________________________________________________________________________________________
up_sampling2d_52 (UpSampling2D) (None, 16, 16, 122) 0 batch_normalization_44[0][0]
__________________________________________________________________________________________________
concatenate_52 (Concatenate) (None, 16, 16, 154) 0 up_sampling2d_52[0][0]
max_pooling2d_51[0][0]
__________________________________________________________________________________________________
conv2d_108 (Conv2D) (None, 16, 16, 58) 142970 concatenate_52[0][0]
__________________________________________________________________________________________________
batch_normalization_45 (BatchNo (None, 16, 16, 58) 232 conv2d_108[0][0]
__________________________________________________________________________________________________
up_sampling2d_53 (UpSampling2D) (None, 32, 32, 58) 0 batch_normalization_45[0][0]
__________________________________________________________________________________________________
concatenate_53 (Concatenate) (None, 32, 32, 74) 0 up_sampling2d_53[0][0]
max_pooling2d_50[0][0]
__________________________________________________________________________________________________
conv2d_109 (Conv2D) (None, 32, 32, 26) 30810 concatenate_53[0][0]
__________________________________________________________________________________________________
batch_normalization_46 (BatchNo (None, 32, 32, 26) 104 conv2d_109[0][0]
__________________________________________________________________________________________________
up_sampling2d_54 (UpSampling2D) (None, 64, 64, 26) 0 batch_normalization_46[0][0]
__________________________________________________________________________________________________
concatenate_54 (Concatenate) (None, 64, 64, 34) 0 up_sampling2d_54[0][0]
max_pooling2d_49[0][0]
__________________________________________________________________________________________________
conv2d_110 (Conv2D) (None, 64, 64, 10) 5450 concatenate_54[0][0]
__________________________________________________________________________________________________
batch_normalization_47 (BatchNo (None, 64, 64, 10) 40 conv2d_110[0][0]
__________________________________________________________________________________________________
up_sampling2d_55 (UpSampling2D) (None, 128, 128, 10) 0 batch_normalization_47[0][0]
__________________________________________________________________________________________________
concatenate_55 (Concatenate) (None, 128, 128, 11) 0 up_sampling2d_55[0][0]
input_8[0][0]
__________________________________________________________________________________________________
conv2d_111 (Conv2D) (None, 128, 128, 2) 354 concatenate_55[0][0]
==================================================================================================
Total params: 11,124,574
Trainable params: 11,122,630
Non-trainable params: 1,944
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x000001CF934F3BE0>
Training time: 11:08:05.758480
(648, 128, 128, 1)
Total round time: 11:08:11.921700
*** Leave-one-out round # 3
Training on 6580 images, validating on 738 images...
Model: "functional_17"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_9 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_112 (Conv2D) (None, 64, 64, 8) 80 input_9[0][0]
__________________________________________________________________________________________________
max_pooling2d_56 (MaxPooling2D) (None, 64, 64, 8) 0 conv2d_112[0][0]
__________________________________________________________________________________________________
conv2d_113 (Conv2D) (None, 32, 32, 16) 1168 max_pooling2d_56[0][0]
__________________________________________________________________________________________________
max_pooling2d_57 (MaxPooling2D) (None, 32, 32, 16) 0 conv2d_113[0][0]
__________________________________________________________________________________________________
conv2d_114 (Conv2D) (None, 16, 16, 32) 4640 max_pooling2d_57[0][0]
__________________________________________________________________________________________________
max_pooling2d_58 (MaxPooling2D) (None, 16, 16, 32) 0 conv2d_114[0][0]
__________________________________________________________________________________________________
conv2d_115 (Conv2D) (None, 8, 8, 64) 18496 max_pooling2d_58[0][0]
__________________________________________________________________________________________________
max_pooling2d_59 (MaxPooling2D) (None, 8, 8, 64) 0 conv2d_115[0][0]
__________________________________________________________________________________________________
conv2d_116 (Conv2D) (None, 4, 4, 128) 73856 max_pooling2d_59[0][0]
__________________________________________________________________________________________________
max_pooling2d_60 (MaxPooling2D) (None, 4, 4, 128) 0 conv2d_116[0][0]
__________________________________________________________________________________________________
conv2d_117 (Conv2D) (None, 2, 2, 256) 295168 max_pooling2d_60[0][0]
__________________________________________________________________________________________________
max_pooling2d_61 (MaxPooling2D) (None, 2, 2, 256) 0 conv2d_117[0][0]
__________________________________________________________________________________________________
conv2d_118 (Conv2D) (None, 1, 1, 512) 1180160 max_pooling2d_61[0][0]
__________________________________________________________________________________________________
max_pooling2d_62 (MaxPooling2D) (None, 1, 1, 512) 0 conv2d_118[0][0]
__________________________________________________________________________________________________
up_sampling2d_56 (UpSampling2D) (None, 2, 2, 512) 0 max_pooling2d_62[0][0]
__________________________________________________________________________________________________
concatenate_56 (Concatenate) (None, 2, 2, 768) 0 up_sampling2d_56[0][0]
max_pooling2d_61[0][0]
__________________________________________________________________________________________________
conv2d_119 (Conv2D) (None, 2, 2, 506) 6218234 concatenate_56[0][0]
__________________________________________________________________________________________________
batch_normalization_48 (BatchNo (None, 2, 2, 506) 2024 conv2d_119[0][0]
__________________________________________________________________________________________________
up_sampling2d_57 (UpSampling2D) (None, 4, 4, 506) 0 batch_normalization_48[0][0]
__________________________________________________________________________________________________
concatenate_57 (Concatenate) (None, 4, 4, 634) 0 up_sampling2d_57[0][0]
max_pooling2d_60[0][0]
__________________________________________________________________________________________________
conv2d_120 (Conv2D) (None, 4, 4, 250) 2536250 concatenate_57[0][0]
__________________________________________________________________________________________________
batch_normalization_49 (BatchNo (None, 4, 4, 250) 1000 conv2d_120[0][0]
__________________________________________________________________________________________________
up_sampling2d_58 (UpSampling2D) (None, 8, 8, 250) 0 batch_normalization_49[0][0]
__________________________________________________________________________________________________
concatenate_58 (Concatenate) (None, 8, 8, 314) 0 up_sampling2d_58[0][0]
max_pooling2d_59[0][0]
__________________________________________________________________________________________________
conv2d_121 (Conv2D) (None, 8, 8, 122) 613050 concatenate_58[0][0]
__________________________________________________________________________________________________
batch_normalization_50 (BatchNo (None, 8, 8, 122) 488 conv2d_121[0][0]
__________________________________________________________________________________________________
up_sampling2d_59 (UpSampling2D) (None, 16, 16, 122) 0 batch_normalization_50[0][0]
__________________________________________________________________________________________________
concatenate_59 (Concatenate) (None, 16, 16, 154) 0 up_sampling2d_59[0][0]
max_pooling2d_58[0][0]
__________________________________________________________________________________________________
conv2d_122 (Conv2D) (None, 16, 16, 58) 142970 concatenate_59[0][0]
__________________________________________________________________________________________________
batch_normalization_51 (BatchNo (None, 16, 16, 58) 232 conv2d_122[0][0]
__________________________________________________________________________________________________
up_sampling2d_60 (UpSampling2D) (None, 32, 32, 58) 0 batch_normalization_51[0][0]
__________________________________________________________________________________________________
concatenate_60 (Concatenate) (None, 32, 32, 74) 0 up_sampling2d_60[0][0]
max_pooling2d_57[0][0]
__________________________________________________________________________________________________
conv2d_123 (Conv2D) (None, 32, 32, 26) 30810 concatenate_60[0][0]
__________________________________________________________________________________________________
batch_normalization_52 (BatchNo (None, 32, 32, 26) 104 conv2d_123[0][0]
__________________________________________________________________________________________________
up_sampling2d_61 (UpSampling2D) (None, 64, 64, 26) 0 batch_normalization_52[0][0]
__________________________________________________________________________________________________
concatenate_61 (Concatenate) (None, 64, 64, 34) 0 up_sampling2d_61[0][0]
max_pooling2d_56[0][0]
__________________________________________________________________________________________________
conv2d_124 (Conv2D) (None, 64, 64, 10) 5450 concatenate_61[0][0]
__________________________________________________________________________________________________
batch_normalization_53 (BatchNo (None, 64, 64, 10) 40 conv2d_124[0][0]
__________________________________________________________________________________________________
up_sampling2d_62 (UpSampling2D) (None, 128, 128, 10) 0 batch_normalization_53[0][0]
__________________________________________________________________________________________________
concatenate_62 (Concatenate) (None, 128, 128, 11) 0 up_sampling2d_62[0][0]
input_9[0][0]
__________________________________________________________________________________________________
conv2d_125 (Conv2D) (None, 128, 128, 2) 354 concatenate_62[0][0]
==================================================================================================
Total params: 11,124,574
Trainable params: 11,122,630
Non-trainable params: 1,944
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x000001CF913A71C0>
Training time: 10:54:55.870503
(738, 128, 128, 1)
Total round time: 10:55:02.493379
*** Leave-one-out round # 4
Training on 6689 images, validating on 629 images...
Model: "functional_19"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_10 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_126 (Conv2D) (None, 64, 64, 8) 80 input_10[0][0]
__________________________________________________________________________________________________
max_pooling2d_63 (MaxPooling2D) (None, 64, 64, 8) 0 conv2d_126[0][0]
__________________________________________________________________________________________________
conv2d_127 (Conv2D) (None, 32, 32, 16) 1168 max_pooling2d_63[0][0]
__________________________________________________________________________________________________
max_pooling2d_64 (MaxPooling2D) (None, 32, 32, 16) 0 conv2d_127[0][0]
__________________________________________________________________________________________________
conv2d_128 (Conv2D) (None, 16, 16, 32) 4640 max_pooling2d_64[0][0]
__________________________________________________________________________________________________
max_pooling2d_65 (MaxPooling2D) (None, 16, 16, 32) 0 conv2d_128[0][0]
__________________________________________________________________________________________________
conv2d_129 (Conv2D) (None, 8, 8, 64) 18496 max_pooling2d_65[0][0]
__________________________________________________________________________________________________
max_pooling2d_66 (MaxPooling2D) (None, 8, 8, 64) 0 conv2d_129[0][0]
__________________________________________________________________________________________________
conv2d_130 (Conv2D) (None, 4, 4, 128) 73856 max_pooling2d_66[0][0]
__________________________________________________________________________________________________
max_pooling2d_67 (MaxPooling2D) (None, 4, 4, 128) 0 conv2d_130[0][0]
__________________________________________________________________________________________________
conv2d_131 (Conv2D) (None, 2, 2, 256) 295168 max_pooling2d_67[0][0]
__________________________________________________________________________________________________
max_pooling2d_68 (MaxPooling2D) (None, 2, 2, 256) 0 conv2d_131[0][0]
__________________________________________________________________________________________________
conv2d_132 (Conv2D) (None, 1, 1, 512) 1180160 max_pooling2d_68[0][0]
__________________________________________________________________________________________________
max_pooling2d_69 (MaxPooling2D) (None, 1, 1, 512) 0 conv2d_132[0][0]
__________________________________________________________________________________________________
up_sampling2d_63 (UpSampling2D) (None, 2, 2, 512) 0 max_pooling2d_69[0][0]
__________________________________________________________________________________________________
concatenate_63 (Concatenate) (None, 2, 2, 768) 0 up_sampling2d_63[0][0]
max_pooling2d_68[0][0]
__________________________________________________________________________________________________
conv2d_133 (Conv2D) (None, 2, 2, 506) 6218234 concatenate_63[0][0]
__________________________________________________________________________________________________
batch_normalization_54 (BatchNo (None, 2, 2, 506) 2024 conv2d_133[0][0]
__________________________________________________________________________________________________
up_sampling2d_64 (UpSampling2D) (None, 4, 4, 506) 0 batch_normalization_54[0][0]
__________________________________________________________________________________________________
concatenate_64 (Concatenate) (None, 4, 4, 634) 0 up_sampling2d_64[0][0]
max_pooling2d_67[0][0]
__________________________________________________________________________________________________
conv2d_134 (Conv2D) (None, 4, 4, 250) 2536250 concatenate_64[0][0]
__________________________________________________________________________________________________
batch_normalization_55 (BatchNo (None, 4, 4, 250) 1000 conv2d_134[0][0]
__________________________________________________________________________________________________
up_sampling2d_65 (UpSampling2D) (None, 8, 8, 250) 0 batch_normalization_55[0][0]
__________________________________________________________________________________________________
concatenate_65 (Concatenate) (None, 8, 8, 314) 0 up_sampling2d_65[0][0]
max_pooling2d_66[0][0]
__________________________________________________________________________________________________
conv2d_135 (Conv2D) (None, 8, 8, 122) 613050 concatenate_65[0][0]
__________________________________________________________________________________________________
batch_normalization_56 (BatchNo (None, 8, 8, 122) 488 conv2d_135[0][0]
__________________________________________________________________________________________________
up_sampling2d_66 (UpSampling2D) (None, 16, 16, 122) 0 batch_normalization_56[0][0]
__________________________________________________________________________________________________
concatenate_66 (Concatenate) (None, 16, 16, 154) 0 up_sampling2d_66[0][0]
max_pooling2d_65[0][0]
__________________________________________________________________________________________________
conv2d_136 (Conv2D) (None, 16, 16, 58) 142970 concatenate_66[0][0]
__________________________________________________________________________________________________
batch_normalization_57 (BatchNo (None, 16, 16, 58) 232 conv2d_136[0][0]
__________________________________________________________________________________________________
up_sampling2d_67 (UpSampling2D) (None, 32, 32, 58) 0 batch_normalization_57[0][0]
__________________________________________________________________________________________________
concatenate_67 (Concatenate) (None, 32, 32, 74) 0 up_sampling2d_67[0][0]
max_pooling2d_64[0][0]
__________________________________________________________________________________________________
conv2d_137 (Conv2D) (None, 32, 32, 26) 30810 concatenate_67[0][0]
__________________________________________________________________________________________________
batch_normalization_58 (BatchNo (None, 32, 32, 26) 104 conv2d_137[0][0]
__________________________________________________________________________________________________
up_sampling2d_68 (UpSampling2D) (None, 64, 64, 26) 0 batch_normalization_58[0][0]
__________________________________________________________________________________________________
concatenate_68 (Concatenate) (None, 64, 64, 34) 0 up_sampling2d_68[0][0]
max_pooling2d_63[0][0]
__________________________________________________________________________________________________
conv2d_138 (Conv2D) (None, 64, 64, 10) 5450 concatenate_68[0][0]
__________________________________________________________________________________________________
batch_normalization_59 (BatchNo (None, 64, 64, 10) 40 conv2d_138[0][0]
__________________________________________________________________________________________________
up_sampling2d_69 (UpSampling2D) (None, 128, 128, 10) 0 batch_normalization_59[0][0]
__________________________________________________________________________________________________
concatenate_69 (Concatenate) (None, 128, 128, 11) 0 up_sampling2d_69[0][0]
input_10[0][0]
__________________________________________________________________________________________________
conv2d_139 (Conv2D) (None, 128, 128, 2) 354 concatenate_69[0][0]
==================================================================================================
Total params: 11,124,574
Trainable params: 11,122,630
Non-trainable params: 1,944
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x000001CF919A87F0>
Training time: 11:06:49.768244
(629, 128, 128, 1)
Total round time: 11:06:55.458738
Total training time: 2 days, 5:39:45.483754